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Our  Poster  Child:  A  Pathological  Example 


y 


>  Constructive  simulation  using  W&A’d  model 

*  year  2020  scenario 

*  mix  of  advanced  and  legacy  aircraft 

*  supporting  expeditionary  ground  force 

>  Objective:  quantify  operational  benefits  of 

*  Network  Centric  Operations  (NCO) 

*  Non-Traditional  Intelligence,  Surveillance, 
and  Reconnaissance  (NTISR) 


This  OA  study  lead  to  a  clear  anomaly 
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All  MOPS  Showed  Improvement  with  NCO 
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NCO/NTISR  improved  a  number  of 
MOPs  without  a  singie  downside. 

>  Reduced  multiple  communication  latencies 

>  Reduced  multiple  decision  latencies 

>  Increased  sensor  information 


Yet  model  results  showed  a  worse  MOM... 
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MOM:  Number  of  Blue  Aircraft  Lost 


A/C  lost 


Improved 
connectivity  & 
information 
increased 
A/A  losses 


...  and  even 
introduced  a 
new  source 
of  losses 


□S/A 

■A/A 


w/o  NCO 


with  NCO 


What’s  going  on? 
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Something  Subtle  Happened 
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The  attentive  child  at  Mother’s  knee 
in  the  mid  1300s  could  tell  us. 


Chaos  entered  the  picture 
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Expressions  of  Chaos 
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>  “For  want  of  a  nail ...” 

English  nursery  rhyme,  c  1360. 

>  “The  fog  and  friction  of  war” 

Carl  von  Clausewitz,  1806 

>  “A  butterfly  in  Tokyo  ...  tornado  in  Topeka” 

chaos  cliche,  c  1975 

>  “Non-monotonicities” 

Andreas  Tolk,  c  1990 

>  Rand/MORSS  Paper:  Non-Monotonicity, 
Chaos,  and  Combat  Models 

J.  A.  Dewar,  et  al.,  1990 


Chaos  comes  under  many  names. 
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Chaos  Label  Varies  by  Discipline 
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>  System  analysis  -  “unstable  dynamic  system” 

>  Statistics  -  “non  strongly  causal” 

>  Our  label  -  “chaotic” 

(extreme  sensitivity  to  initiai  conditions) 


Probiems  lurk  in  our  models’  woodwork. 
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One  Genius’  Take ... 
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“A  critical,  if  somewhat  hidden,  assumption 
is  that  given  only  an  approximate  rather 
than  an  exact  knowledge  of  a  system's 
initial  conditions,  one  can  still  calculate  at 
least  the  system's  approximate  behavior.” 

Richard  Feynman 


This  applies  to  military  OA  -  read  “initial 
conditions”  as  scenario,  threat  laydown,  ... 
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Combat  is  Intrinsically  Chaotic 
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The  more  realistic  our  models, 
the  more  possibility  that  chaotic 
outcomes  will  occlude  insight. 


Chaotic  instabilities  can  occur  in  both 
deterministic  and  stochastic  models. 
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There  are  Means  to  Treat  Chaos 
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>  Replications  with  identical  input  heips 
resolve  Monte  Carlo  noise  but  doesn’t 
resoive  sensitivity  to  initiai  conditions 

>  Sampiing  the  probiem  (input)  space  can 
heip  resoive  chaotic-system  noise  -  for 
some  chaotic  systems,  the  fuii  response 
ensembie  can  be  depicted 


Deveioping  soiutions  requires  a  ciear 
understanding  of  the  probiem  source. 
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A  Few  Sources  of  Chaotic  Effects 
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A  combat  model  is  a  response  function,  F,  mapping 
system  MOPs,  CONORS,  and  scenarios  into  outcomes. 

Resuits  =  F(  MOPs,  CONORS,  scenario  ) 

Each  argument  and  F( )  itself  holds  chaotic  risk: 

>  Feedback,  or  chance,  in  F( ) 

>  Threshoid  sensitivities  to  MOPs  or  scenario 

>  Non-optimal  CONORS  by  Red  or  Biue 


How  can  we  deai  with  chaotic  systems? 
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Good  Advice 
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“Think  deeply  of  simple  things.” 

Arnold  Ross 


We  begin  our  probe  with  a  simpie  problem. 
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A  Simple  Problem 
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Sensitivity  of  Radar-iock  to  RCS: 

>  Spherical  signature 

>  Cookie-cutter  ^RCS  range 

>  Sensitivity:  100  nm  vs.  1  RCS 


The  sensitivity  depends  on  our  scenario 
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RCS  Impact  Depends  on  Threat  Offset 
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We  can  hedge  our  bet  as  to  which  offset. 
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Equally-Weighted  Results  for 
an  Ensemble  of  Three  Offsets 
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RCS  ■  sq  meters 


We  could  use  many  randomized  offsets... 
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Equally-Weighted  Results 
for  25  Random  Offsets 
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For  this  simple  problem,  we  can  find  the  full  ensemble. 
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Representing  the  Ensemble  of  All  Offsets 
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Prob. 

avoid 

radar 

lock 


Full  chaotic  reality  is  not  this  nice 
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Chaotic  Reality  May  Not  Serve 
the  Design-Trade  Process 
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A  “realistic”  instantiation  might  give  this  result: 


ir" 


Relative 
prob. 

avoid 
radar 
lock 


Real-world  with  multiple  threats 
where  any  maneuvering  can  have 
very  unpredictable  later  impacts. 


O'— 
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RCS  -  sq  meters 


80 


100 


Can  we  obtain  smooth  ensemble  responses 
for  meaningfully  complex  problems? 
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Example:  A  More  Complex  SAM  Encounter 
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We  built  BLINK,  a  proof-of-concept  ensemble  model 
sensitive  to  several  aircraft  and  missile  parameters: 


> Aspect-sensitive  aircraft 
signature  (radar  range) 

>Terrain  masking  (Line  Of  Sight) 

> Intercept  kinematics  (A/C  and 
missile  mach,  altitude,  delays) 


The  BLINK  model  examines  these  sensitivities. 
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Radar  Lock,  LOS,  and  Kinematics 
Combine  Via  a  Simpie  Seriai  System 


y 


All  three  factors  must  “work”  for  an  intercept: 
P(encr)  =  P(rdr  range)*P(LOS)*P(kinematics) 

Each  factor  in  the  combination  requires  a 
canonical  form  with  the  correct  shape  and 
asymptotical  behavior  -  polynomiais  almost 
never  provide  suitable  canonical  forms. 


Let’s  examine  each  component  P( ). 
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1.  SAM  Radar  Range 
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^XJ 


Plot  of  Radar  Range  (w/  background  noise) 


SAM  Parameters- 


2000  sustain  velocity  Sustain  veloc.,  knots 

nstoaitituc.,  li'fne  to  Altitude,  sec 

400  time  to  burnout,  l^ime  to  Burnout,  sec 
coastdown  time,  Boast-down,  sec 
ansevs  CdB  r^l-l-ng  VS  1  SQ  Uieter 


velocity,  knots  Velocity,  knots 
42000  altitude,  feet  Altitude,  feet 

h^'ing  deg  ccwX 


Plot  parameters  - 

-\  indep  axes 
Radar  Range  2]  surface  to  plot 

what/how  to  plot 
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P(LOS) 


2.  Line  of  Sight  (LOS) 


Plot  of  Probability  of  LOS 
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SAM  Parameters- 


r 

2000 

sustain  velocity,  knots 
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15 

range  vs.  0  dBsm,  nm 
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r 

1000 

velocity,  knots 
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r 

0 
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Show  PCS  1 

Plot  Parameters- 


1  50 

#grid  pts  per  dimension 

1  100 

grid  extent. 

+  -  nm 

|X  ,  Y 

indep  axes 

|Prob(LOS) 

surface  to  plot 

Moderate 

terrain 

Surface 

j  1  plot  type 

Show  Plot 

1_ I 

Show  Encounter  Statistics 
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P(SAM  Kinematics) 


3.  SAM  Kinematic  Range 
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SAM  Kinematic  Intercept  Range 


Y  in  nm  from  SAM  TEL  -1 00  -100 


X  in  nm  from  SAM  TEL 


^x] 


-  SAM  Parameters - 

I  2000  sustain  velocity,  knots 

I  250  time  to  altitude,  sec 

I  400  time  to  burnout,  sec 

I  20  coastdown  time,  sec 

I  15  range  vs.  0  dBsm,  nm 

- AC  Parameters - 

I  1000  velocity,  knots 

I  42000  altitude,  feet 

I  0  heading,  degees  off  x 

Show  PCS  I 


100 


Plot  Parameters- 


50  #  grid  pts  per  dimension 


100  grid  extent,  -n-nm 
X  ,  Y  ^  indep  axes 

Kinematics  ^  surface  to  plot 

Moderate  ^  terrain 

Surface  ^  plot  type 


Show  Plot  I 


Show  Encounter  Statistics 
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P(  Encounter ) 


Combined  Probability  of  Encounter 
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SAM  Effectiveness  vs.  Aircraft  Position 


Jnjxl 


SAM  Parameters- 


r 

2000 

sustain  velocity,  knots 

r 

250 

time  to  altitude,  sec 

r 

400 

time  to  burnout,  sec 

r 

20 

coastdown  time,  sec 

r 

15 

range  vs.  0  dBsm,  nm 

- AC  Parameters - 

I  1000  velocity,  knots 

j  42000  altitude,  feet 

0  heading,  degees  off  X 


Show  PCS 

Dint  DoKomoforo 

1  50 

#grid  pts  per  dimension 

1  100 

grid  extent. 

+  -  nm 

|x  ,  Y 

1  indep  axes 

Combined 

2^  surface  to  plot 

Moderate 

jJ  terrain 

Surface 

jJ  plot 

t  type 

1  Show  Plot 

Show  Encounter  Statistics 


How  can  we  use  this  ensemble? 
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BUNK  Provides  Encounter  Areas  and  Widths 


Determines 
detection 
rate  of  pop¬ 
up  SAMs 


Determines 
opportunity 
rate  by  pop¬ 
up  SAMs  ^ 


Effective  Encounter  Region  Stats 


_  ^2S] 

Effective  Encounter  Areas  truncated  at  the  plot  limits: 

L  I  A/C  EE  A,  360  deg  FOV  sensor  =  30748.1  nm'^2 
A/C  EEA.  1 80  deg  FOV  sensor  =  1 5374.1  nm"2 


A/C  EEA,  1 20  deg  FOV  sensor  =  1 0756.2  nm'^2 
A/C  EEA,  60  deg  FOV  sensor  =  4553.8  nm'^2 

5  AM  EE  A,  all  aspect  =  2634.3  nm'^2 

SAM  EEWidth  in  Y  direction  =  106.2  nm 


OK 


r  Determines 
opportunity 
rate  by  cued 
^  SAMs  A 


Given  these  areas  and  widths,  a  statisticai  mechanical 
methodology  gives  relative  or  absolute  encounter  rates 
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Example  Results 


Relative  SAM  Encounters  vs.  Mach  and  Signature 


To  be  usefui,  we  must  be  able  to  extend  this  approach 
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Possible  Extensions  of  BLINK 


y 


>  Missile  P(kill)  by  intercept  aspect 

-  easy  to  incorporate  as  intercept  aspect  is  known 

>  3-D  signatures 

-  not  difficuit  given  a  fiyout  aititude-profiie 

>  Kinematic-escape  maneuvering 

-  easiiy  feasibie  (but  probabiy  not  dosed  form) 

>  Signature-management  maneuvering 

-  probabiy  oniy  first-order  effects 

>  A/C  energy  management  per  dogfight 

-  quite  difficuit 


How  do  ensembie  models  compare  with  instantiation? 
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Approaches  to  Modeling  Chaotic  Systems 
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Representation 
of  probabilistic 
effects  and  input 
sensitivities 


Advantages 


Disadvantages 


Mitigation  of 
chaotic  effects 
within  the  given 
MOPs,  scenario 
and  CONORS 

Mitigation  of 
chaotic  effects 
resuiting  from 
MOPs,  scenario 
or  CONORS. 


Instantiation  Model 

Ensemble  Model 

Models  sampled  values,  that  is, 
instantiations  -  “tail-number 
modeling.”  Objects  in  the  model 
are  typically  physical  entities:  a 
SAM  site,  a  strike  A/C,  ... 

Models  distributions,  not  specific 
realizations.  Initial  conditions  are 
often  distributions  -  some  inputs 
and  all  results  are  ensembles  that 
reflect  distributions. 

Models  capture  extensive  detail  - 
“gets  down  in  the  weeds.”  Easy 
to  visualize  and  to  explain  the 
model.  “Presentation  friendly.” 

Models  generate  an  ensemble 
of  outcomes  by  a  distributional 
calculus  such  as  Bayesian 
networks  or  influence  diagrams. 

Can  be  difficult  or  impossible  to 
ensure  representative  results. 

Models  cover  only  limited  detail. 
Often  hard  to  visualize  or  explain. 

If  non-deterministic,  replications 
obtain  the  mean  response  for  the 
MOPs,  scenario,  and  COAfOPS. 
Computational  demands  can  be 
daunting. 

Because  the  model  treats  the 
complete  ensemble,  not  single 
instantiations,  chaotic  effects 
are  intrinsically  treated  in  the 
outcome  distribution. 

Chaos  in  the  Scenario  and 

CONORS  quite  difficult  to  treat. 
Parametric  studies  are  usually 
computationally  constrained. 

Chaos  in  the  Scenario  and  the 
CONORS  is  usually  treatable  by 
either  an  input  distribution  or 
by  parametric  studies. 
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But  What  About  Our  Opening  Example? 


A  clue  is  supplied  by  a  second  MOM  -  Red  losses. 


w/o  NCO  with  NCO 


The  appearance  of  S/A  losses  was  never  explained 


Unclassified 


On  Missing  Naiis  and  Distant  Butterflies 


Lockheed  Martin  Aeronautics  Company 


Chart  Number  30 


The  Take-Home  Message 
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> Instantiation  models  can  have 
excellent  resolution  and  fidelity 

>But ...  hidden  among  the  weeds  can 
lurk  undetected  chaotic  effects 
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End  of  presentation  - 
backup  slides  follow 
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Kinematic  Range  is  Based  on  Time  To  intercep 


Time  to  Intercept,  T2i,  Provides  a  Canonical  Expression  for  Intercept  Time/Location 


A'C  at  (xO,yO) 


SAM  TEL 
at  (0,0) 


Wi  assume  a  non-maneuvering  A/C,  and  perfectly  predictive  missile  flight  path.  Our  missile 
3-D  distance-flown  approximation  is  d  =  ¥m*(t  -  to)  for  t  >  to 

This  projects  into  an  x,y  distance-flown,  d  =  ^ [™i  (t  -  to)  +  h]^  -  where  we  can  think  of  tO  as 
"time  to  altitude".  Our  equations  of  motion  are 

aircraft:  k  =  xO  +  v  cos(j)  t  y  =  yO  +  v  sin(f)  t 

missile:  xm  =  cos(a)*’y[™'(t  -  tO)  +  h]^  -  ym  =  sin((L)'' ^ [™  (t  -  tO)  +  h]^  - 

Here  v  =  A/C  speed,  vm  =  missile  sustain  speed,  (xO,yO)  =  A/C  location  at  t  =  0,  h  =  A/C  altitude, 
to  =  "missile  time  to  altitude",  ^  =  A!C  heading  with  a  =  sin(<|>)  and  b  =  cos(<|>),  a  =  intercept  heading. 

Ifwe  find  the  intercept  time,  we  can  impute  missile  kinematic  limits  from  an  approximation  of  the 
missile  coast  down  dynamics. 


Solving  the  A/C  and  SAM  equations  of  motion  for  time  of  intercept,  T2i,  we  obtain: 


T2i 


2  I  2  2  2 

y0  v  b  +  s0  v  a  +  ™  tO  -  vm  h  +  ^^2  yO  v  b  xO  a  +  2  yO  v  b  vm  tO  -  2  yO  v  b  vm  h  +  2  xO  v  a  vm  t0-2x0vavmh  + 


2,2  2 

til  h  +  V 


2  .  2 

i  vm  to  -  2  V 


2  2 

i  vm  to  h  -  V 


2  „2  2,2  „2  2,2 

i  yO  -  V  b  xD  +  V  b  1 


2  2  2  2  2  2 

fi  lO  -2  V  b  vmtO  h  +  vm  xO  H 


yO 


One  can  do  a  similar  analysis  for  an  A/C  attempting  kinematic  range  evasion 
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Cautions 


y 


Ensemble  models  must  stand 
on  solid  physics  or  statistics. 

Otherwise  they  risk  becoming 
“truthiness”  modeis,  yieiding 
what  Richard  Feynman  wouid 
caii  “Cargo-Cuit  Anaiysis.” 
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